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Abstract 

In this paper, multi-agent systems minimizing a sum of objective functions, where each 
component is only known to a particular node, is considered for continuous-time dynamics 
with time- varying interconnection topologies. Assuming that each node can observe a convex 
solution set of its optimization component, and the intersection of all such sets is nonempty, 
the considered optimization problem is converted to an intersection computation problem. 
By a simple distributed control rule, the considered multi-agent system with continuous-time 
dynamics achieves not only a consensus, but also an optimal agreement within the optimal 
solution set of the overall optimization objective. Directed and bidirectional communications 
are studied, respectively, and connectivity conditions are given to ensure a global optimal 
consensus. In this way, the corresponding intersection computation problem is solved by the 
proposed decentralized continuous-time algorithm. We establish several important properties 
of the distance functions with respect to the global optimal solution set and a class of invariant 
sets with the help of convex and non-smooth analysis. 

Keywords: Multi-agent systems, Optimal consensus, Connectivity Conditions, Distributed 
optimization, Intersection computation 

1 Introduction 

In recent years, multi-agent dynamics has been intensively investigated in various areas including 

engineering, natural science, and social science. Cooperative control of multi-agent systems is an 
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active research topic, and rapid developments of distributed control protocols via interconnected 
communication have been made to achieve the collective tasks, e.g., (T(2 E5J H2J [251 Ml EJ EUJ 
[22" 1 I17 [ [18] . However, fundamental challenges still lie in finding suitable tools to describe and 
design the dynamical behavior of these systems and thus providing insights in their functioning 
principles. Different from the classical control design, the multi- agent studies aim at fully 
exploiting, rather than avoiding, interconnection between agents in analysis and synthesis in 
order to deal with distributed design and large-scale information process. 

Consensus is a basic problem of the study of multi-agent coordination, which usually requires 
that all the agents achieve the same state, e.g., a certain relative position or velocity. To achieve 
collective behavior, connectivity plays a key role in the coordination of multi-agent network, 
and various connectivity conditions have been used to describe frequently switching topologies 
in different cases. The "joint connection" or similar concepts are important in the analysis of 
stability and convergence to guarantee a suitable convergence. Uniform joint-connection, i.e., 
the joint graph is connected during all intervals which are longer than a constant, has been 
employed for different consensus problems [H3 EH EH ESI E] • On the other hand, [t, oo)-joint 
connectedness, i.e., the joint graph is connected in the time intervals [t, oo), is necessary |221I25| . 
and therefore the most general form to secure the global coordination. 

Moreover, distributed optimization of a sum of convex objective functions, Xa=i fi( z )i where 
each component fi is known only to node i, has attracted much attention in recent years, due 
to its wide application in multi-agent systems and wireless networks [291 EH [32], [3H [33] . A class 
of subgradient-based incremental when some estimate of the optimal solution can be passed 
over the network via deterministic or randomized iteration were studied in |29[ [30]. [M] . Then a 
non-gradient-based algorithm was proposed in [33], where each node starts at its own optimal 
solution and updates using a pairwise equalizing protocol. In view of multi-agent systems, the 
local information transmitted over the neighborhood is usually limited to a convex combina- 
tion of its neighbors |161 [To"! [25] . Combining the ideas of consensus algorithms and subgradient 
methods, a number of significant results were obtained. A subgradient method in combination 
with consensus steps was given for solving coupled optimization problems with fixed undirected 
topology in [31]. Then, an important work on multi-agent optimization was [27], where a 
decentralized algorithm was proposed as a simple sum of an averaging (consensus) part and a 
subgradient part, and convergence bounds for a distributed multi- agent model under various 
connectivity conditions were shown. Constrained consensus and optimization were further stud- 
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ied in [25], where each agent was always restricted in its own convex set. A "projected consensus 
algorithm" was presented to solve the constrained consensus problem in which each agent takes 
averaging and projection steps alternatively, and it was generalized to "projected subgradient 
algorithm" with optimization goal also took into consideration |28j . 

Most of the literature on optimization and consensus algorithms is in discrete time, and it is 
usually hard for the considered agents to reach both consensus and optimum unless the weights 
rule of the links, the step size in the iteration and the connectedness of the communication 
graph are properly selected (27J GEJ [30] . Few researchers have considered continuous-time agent 
dynamics that solves a distributed optimization problem. However, dynamical system solution 
to optimization problem is of great interest since a simple vector-field solution may provide 
important geometrical insights. The classical Arrow-Hurwicz-Uzawa flow was shown to converge 
to the set of saddle points for a constrained convex optimization problem |41j . Then in |42j . 
a simple and elegant continuous-time protocol was presented which solves linear programming 
problems. 

The goal of this paper is to establish a simple distributed continuous-time control law which 
can ensure consensus and minimize fi( z ) asymptotically. Each optimal solution set, Xi of 

optimization objective fi(z), is assumed to be a convex set observed only by node i. Assuming 
that the intersection set, f]i = iX{, is nonempty, the optimal solution set of the group objective 
becomes this intersection set, and the considered optimization problem is then converted to a 
distributed intersection computation problem. In fact, computing several convex sets' inter- 
section is a classical problem, and "alternating projection algorithm" was a standard solution, 
in which the algorithm is carried out by iteratively projecting onto each set [38] |39[ I40j . The 
"projected consensus algorithm" presented in [28J can be viewed as its generalized version. The 
intersection computation problem is also of interest in the study of computational geometry, a 
branch of computer science |44[ I45j . Hence, an important motivation for our work is to provide 
a system-theoretic insight into the convergence properties of certain distributed optimization 
problems. Similar to the continuous-time approximation of recursive algorithms [43J and con- 
strained optimizations |41] |42j. we establish a suitable dynamical model for such analysis. Also 
by itself, the considered continuous-time distributed optimization problem has many applica- 
tions, e.g., wireless resource allocation [29} 130]. formation control [9[ 122] [14"]. and mobile sensing 

PZHE7]. 

In this paper, we present a simple dynamical system solution to this convex intersection 
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computation problem, as the sum of a consensus part and a projection part. Since this pro- 
jection part can be viewed as a special subgradient information, this protocol is actually a 
continuous-time version of the algorithm proposed in [27]. We show that an optimal consen- 
sus (i.e., consensus within the global optimal solution set), can be achieved under time- varying 
communications. Both directed and bidirectional cases are investigated, and sharp connectivity 
conditions are obtained in the sense that a general optimal consensus will no longer hold for a 
general model with weaker connectedness. Additionally, we use quite general weights rule which 
allow the weight of each arc in the communication graph to depend on time or system state. 

The rest of the paper is organized as follows. In Section 2, some preliminary concepts are 
introduced. In Section 3, we formulate the considered optimal consensus problem, and the main 
results are shown. Then, in Sections 4 and 5, convergence to the optimal solution set and global 
consensus are analyzed, respectively, based on which the proofs of the main results are obtained. 
Finally, in Section 6 concluding remarks are given. 

2 Preliminaries 

In this section, we introduce some notations and theories on graph theory [4], convex analysis 
[U [3] and nonsmooth analysis [5] . 

A directed graph (digraph) Q = (V, £ ) consists of a finite set V of nodes and an arc set 
£, in which an arc is an ordered pair of distinct nodes of V. An element (i, j) G £ de- 
scribes an arc which leaves i and enters j. A walk in digraph Q is an alternating sequence 
W : i\&\i2^2 ■ ■ ■ Cm-iim of nodes i K and arcs e K = {i K ,i K+ \) G £ for k = 1, 2, . . . , m— 1. A walk is 
called a path if the nodes of this walk are distinct, and a path from i to j is denoted as i — > j. Q 
is said to be strongly connected if it contains path i — > j and j — > i for every pair of nodes i and 
j. A digraph Q is called to be bidirectional when for any two nodes i and j, G £ if and only 
if (j, i) G £. Ignoring the direction of the arcs, the connectedness of a bidirectional digraph will 
be transformed to that of the corresponding undirected graph. A time-varying graph is defined 
as ^o-(t) = (^)^o-(t)) with a : [0, +oo) — > Q as a piecewise constant function, where Q is a finite 
set indicating all possible graphs. Moreover, the joint graph of Q a (t) i n time interval [ti, £2) with 
h < t 2 < +00 is denoted as G([ti,t 2 )) = U t€[tut2) g(t) = (V, Ute[t lt t 3 )£<T(t)) ■ 

A set K C R m is said to be convex if (1 — \)x + Xy G K whenever x G K,y G K and 
< A < 1. For any set S C H m , the intersection of all convex sets containing S is called the 
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convex hull of S, denoted by co(S). The next lemma can be found in [2]. 

Lemma 2.1 Let K be a subset ofH m . The convex hull co{K) of K is the set of elements of 
the form 

rn+l 

x — ^ AjXj, 
i=i 

where Aj > 0, i = 1, . . . , m + 1 with X}fc=i A« = 1 and Xi E K . 

Let K be a closed convex subset in R m and denote \x\k = inf^^- |x — y| as the distance 
between x G R m and K, where | • | denotes the Euclidean norm. There is a unique element 
Pr{x) E K satisfying \x — Pk{x)\ = \x\k associated to any x G R m [2]. The map Pk is called 
the projector onto K. We also have 

(P K (x)-x,P K (x)-y) <0, VytK. (1) 

Moreover, Pk has the following non-expansiveness property: 

\P K (x) - P K (y)\ < \x-y\,x,y e R m . (2) 

Clearly, jx)^ is continuously differentiable at point x, and (see [2]) 

V|x|| = 2(x - P K (x)). (3) 

The following lemma was obtained in [22] . which is useful in what follows. 

Lemma 2.2 Suppose K C IR, m is a convex set and x a ,x& € R m . T/ien 

(x a - P K (x a ),x b - x a ) < \x a \ K ■ \\xo\k - \xb\x\ ■ (4) 

Particularly, if \x a \x > \xb\K, then 

(X a - PK(x a ),X b - X a ) < -\x a \ K ■ (\x a \ K ~ \xb\ic)- (5) 



Next, the upper Dini derivative of a continuous function h : (a, b) — > R (—00 < a < b < 00) 
at t is defined as 

/ n hCt + s) - hit) 
D + h(t) = limsup — — . 

When h is continuous on (a,b), h is non-increasing on (a, b) if and only if D + h(t) < for any 
t G (a, b). The next result is given for the calculation of Dini derivative (see [61 124j). 
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Lemma 2.3 Let Vi(t, x) : R x R d — > R (i = 1, . . . , n) be C 1 and V(t, x) = maxj = i t ... )f , VJ(i, a;). 
Ifl(t) = {i G {1, 2, . . . , n} : V(t, a;(i)) = Vi(t, is £/ie set of indices where the maximum is 

reached at t, then D + V(t,x(t)) = maxj e x(t) ^K^^))- 

Finally, consider a system 

x = /(t,z), (6) 

where / :Ex IR d — > R d is piecewise continuous in t and continuous in x. Let a:(i) = to, x°) 
be a solution of ^ with initial condition x(io) = s^ - Then S7o C M, d is called a positively 
invariant set of Q if, for any to £ R and any x° E f^o, tcb x °) £ when t > to- 

3 Problem Formulation and Main Results 

In this section, we first define the considered optimal consensus problem. We propose a multi- 
agent optimization model and a distributed control law to solve this optimization problem. Then 
the main results are presented on connectivity conditions which can ensure an optimal consensus 
globally. 

3.1 Multi-agent Model 

Consider a multi- agent system with agent set V = {1, 2, ... , N}, for which the dynamics of each 
agent is a first-order integrator: 

±i = m, % = 1, . . . ,N (7) 

where X{ G R m represents the state of agent i, and Ui is the control input. 

The communication in the multi-agent network is modeled as a time-varying graph Q a (t) = 
(V, S a r t \ ) . Moreover, node j is said to be a neighbor of i at time t when there is an arc (j, i) G £ a (t) i 
and Ni(o~(t)) represents the set of agent i's neighbors at time t. As usual in the literature 
\15\ [2"H I22j. an assumption is given to the variation of Q a {t)- 

Al (Dwell Time) There is a lower bound constant to > between two consecutive switching 
time instants of o~(t). 

We have the following definition. 

Definition 3.1 (i) G a (t) ^ s sa *^ t° be uniformly jointly strongly connected (UJSC) if there exists 
a constant T > such that Q([t, t + T)) is strongly connected for any t > 0. 
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(ii) Assume that G a (t),t > is bidirectional. Q a (t) is sa id t° be infinitely jointly connected 
(IJC) if Q([t, +00)) is connected for all t > 0. 

Remark 3.1 [t, +oo)-joint connectedness for all t > is equivalent to that there exists an 
unbounded time sequence < t\ < ■ ■ ■ < tf~ < ifc+i < • • • such that G([tk, ifc+i)) is connected for 
all k = 1,2, ... . Note that it does not require an upper bound for |tfc+i — */c| in the definition. 

The objective for this group of autonomous agents is to reach a consensus, and meanwhile to 
cooperatively solve the following optimization problem 

N 

min V/i(z) (8) 
i=l 

where fi : H m — > IR represents the cost function of agent i, observed by agent i only, and z is 
a decision vector. We suppose the optimal solution set of each component exists, denoted 
Xi = {v \fi(v) = mm fi{z)}. 

We impose the following assumptions. 
A2 ( Convexity) Xi, . . . , X^, are closed convex sets. 

N 

A3 (Nonempty Intersection) Xq = f] Xi is nonempty and bounded. 

i=i 

Remark 3.2 The assumption that each Xi is a convex set is quite general, and it is not hard 
to see that this assumption will be satisfied as long as each fi is a convex function. Moreover, 
since the intersection of convex sets is a convex set itself, Xq is a convex set with the convexity 
of each Xi. Additionally, with A3, it is obvious to see that Xq is compact, and it is the optimal 
solution set of |<§p. 

3.2 Distributed Control 

Denote x = (xf, . . . , x r ^) T 6 R mAr and let the continuous function aij(x, t) > be the weight of 
arc for i,j G V. Then we present the following distributed control law: 

Ui= ^2 a i j(x,t)(xj — Xi) + Px i (x i ) — Xi,i = l,...,N (9) 

Remark 3.3 We write the arc weight aij(x,t) in a quite general form showing that this weight 
function can be time-varying and may depend nonlinearly on the state. Note that this doesn't 
mean global information is required for the control design. 
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Remark 3.4 When Xi can be observed by node i, P Xi {xi{t)) — Xi(t) can be easily obtained. 
For instance, node i may first establish a local coordinate system, and then construct a function 
h{z) = \z\ 2 x . to compute Vh(z) within this coordinate system. Then by we have P Xi (xi(t)) — 
Xi (t) = -l/2Vh{z)\ z=Xi{t) . 

Another assumption is made on each aij(x,t),i, j = 1,2, ...,N. 
A4 (Weights Rule) There are a* > and a* > such that 



a*<a ij (x,t)<a*, t G R + , x G R miV . 

In this paper, we assume that Assumptions A1-A4 always hold. With ([7]) and ([9]), the closed 
loop system is expressed by 

Xi= aij(x,t)(xj-Xi)+P Xi (xi) — Xi,i = l,...,N. (10) 

jeN z (a(t)) 

Remark 3.5 By the non-expansiveness property Wd, the convex projection Pr{z) is continuous 
for all z G R m for any closed convex set K C R m . Therefore, a solution of exists at least 
over a finite interval for any initial condition x(to). Note that the solution is not necessarily 
unique. As will be shown in Remark J^.l, it also exists in [to,+oo). 

Remark 3.6 Since the projection term can be viewed as a subgradient for the special case 



fi{z) = \z\ x ./2, (10) is actually a continuous-time version of the algorithm proposed in \27$ , 
which has the form of the sum of a consensus term and a subgradient term. On the other hand, 
in I28\j . a "projected consensus algorithm" was presented to solve the same intersection com- 



putation problem in which each agent takes consensus and projection steps alternatively. Note 



that there is some essential difference between (10) and the "projected consensus algorithm" in 



~23\/ . because (10) takes advantage of the consensus and projection information at the same time 



instant. It is not hard to construct examples in which each node i would never enter its own set 



Xi along the trajectories of (10). 



Let x(t) be the trajectory of (10) with initial condition x° = x(to) = (xJ(to), ■ ■ ■ ,xjy(io)) T G 



Il mAr . Then the considered optimal consensus is defined as following (see Fig. [I]). 



Definition 3.2 (i) A global optimal set convergence of (10) is achieved if for all x° G R m7V ; we 
have 

lim \ Xi (t)\ Xo =0, i = l,...,N. (11) 

t— >+oo 




Figure 1: The goal of the agents is to achieve a consensus in Xq. 



(ii) A global consensus of (10) is achieved if for all x° S R mAr , we have 



lim \xi(t) - xj(t)\ = 0, i,j = l, 

t— >+oo 



N. 



(Hi) A global optimal consensus is achieved of (10) if both (i) and (ii) hold 



(12) 



Remark 3.7 It is easy to find that, based on the analysis methods we provide, all the results 



obtained in this paper will still hold if the control law (10) is replaced by 



±i= aij(x,t)(xj - Xi) + bi(xi,t)(P Xl (xi) - Xi), i = 1, . . . ,N 

for some scalar functions < 6* < bi(xi,t),i = 1, ■ ■ ■ ,N with b* > being a constant. Here we 



just choose the form of (10) to make the statements and proofs simplified. 



3.3 Main Results 

In this subsection, we present the main results on optimal consensus. 
First the following conclusion is our main result for directed graphs. 



Theorem 3.1 System (10) achieves a global optimal consensus if Q a (t) is UJSC. 



We say the communications over the considered multi-agent network are bidirectional if 
G a (t) i s a bidirectional graph for all t > to. Note that, this does not imply that the arc weights, 
a,ij(x,t),i, j = 1,...,N, are symmetric. Then we have the following main result on optimal 
consensus for the bidirectional case. 
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Theorem 3.2 System (10) with bidirectional communications achieves a global optimal consen- 



sus if (and in general only if) Q a {t) * s UC. 



Theorem 3.2 shows that the connectedness conditions to reach an optimal consensus can be 
relaxed for bidirectional communications without requiring a uniform bound of the length of 
intervals in the definition of connectivities. 

Remark 3.8 Let us explain what "in general only if" means in Theorems 3.2. Clearly, the 
connectivity condition proposed in Theorem 3.2 is not a necessary condition to ensure a global 
optimal consensus for a particular optimization problem Q). However, in regard to a global 
optimal consensus for all possibilities of X±, . . . ,Xn, simple examples could show that this IJC 
assumption is also necessary using the same idea studying state agreement problem in 125[ \22\j . 
In fact, as long as HiLi ^ s n °t a singleton, it can be easily shown that consensus cannot be 



guaranteed for all initial conditions. Therefore, from this perspective, Theorem 3.2 gives "sharp" 



connectivity conditions for a global optimal consensus of system (10) 



Remark 3.9 If A3, the nonempty intersection assumption, is removed, control law (10) becomes 



a special case of the target aggregation controller studied in (221 with respect to co(\J^ =1 Xj). 
In this case, under proper connectivity assumptions ( even each node cannot always obtain the 
information of Xi), it can be shown that (10) will lead the network to converge into co((J- 1 Xi) 



\22j . The dynamics within co(\jf =1 Xi) can be complicated, and the optimal consensus will 
fail since there is no longer a simple expression of X*, the real optimal solution set of |§p. 



However, we guess that in this case the control law (10) still implies a suboptimal convergence 
such that there will be a constant B, which does not depend on the initial condition, satisfying 
limsup^oQ |xi(t)|x* < B under UJSC connectivity conditions. 



In order to prove Theorems 3.1 and 3.2 on one hand, we have to prove all the agents 
converge to the global optimal solution set, i.e., Xq\ and, on the other hand, we have to verify 
that a consensus is also achieved. In fact, the convergence analysis is quite challenging, due to 
the nonlinearity nature of each weight function a,ij(x,t) and the convex projection part in the 
control law. In the following two sections, we will focus on the optimal solution set convergence 



and the consensus analysis, respectively, by which complete the proofs for Theorems 3.1 and 
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4 Optimal Set Convergence 



In this section, we prove the optimal solution set convergence for system (10). We first establish 
a method to analyze the distance between the agents and the global optimal set with the help 
of convex analysis, and then the convergence to Xq for all the agents is proposed under directed 
and bidirectional communications, respectively. 

4.1 Distance Function 



Define di(t) = \xi(t)\ x and let 



d(t) = max di(t) 



be the maximum among all the agents. Although d(t) may not be continuously differentiable, 
it is still continuous. Thus, we can analyze the Dini derivative of d(t) to study its convergence 
property. Moreover, it is easy to see that d(t) is locally Lipschitz. Then the Dini derivative of 
d(t) is finite for any t. 

We prove several elementary lemmas for the following analysis. At first, the following lemma 
indicates that d(t) is nonincreasing. 

Lemma 4.1 D + d(t) < for all t > 0. 

Proof. According to ([3]), one has 

^di(t) = 2(xi - P Xo (xi),Xi) 

= 2(xi - P Xo (xi), aij(x,t)(xj - Xi) + P Xl (xi) - Xi). (13) 



Then, based on Lemma [2. 3| and denoting X(t) as the set containing all the agents that reach the 
maximum in the definition of d(t) at time t, we obtain 

D + d(t) = max ^-dAt) 
y 1 iex(t) dt * w 

= 2 max[(xj - P Xo (xi), V, a ij( x j ~ x i) + Pxifai) ~ a?i)]- (14) 



Furthermore, for any i G 1(t), according to §5§ of Lemma 2.2 one has 



(xi - Px (xi),Xj - Xi) < (15) 
for any j G Li(a(t)) since it always holds that |xj|x < |^i|x - 

11 



Moreover, in light of Q, we obtain 

{PxM) - Px (xi),P Xi (xi) -Xi)<0 



(16) 



since we always have Px (xi) G X{ for all i = 1, . . . , N. Therefore, it is easy to see that for any 
i e V, 



(Xi - Px (Xi),PXi(Xi) - Xi) < (Xi - P Xl (Xi),P Xl (Xi) - Xi) = -\x 



i\Xi- 



Thus, with (14), (15) and (17), one has 



D + d(t) < 2 max[-\xi\ 2 x ] < 0. 



Then the proof is completed. 



(17) 

(18) 
□ 



Remark 4.1 According to Lemma 4-1 . {y\ \y\x — ^(^o)} * s a positively invariant set for system 



(10). Since Xq is compact, {y\ \y\ x < d(to)} is also compact. This leads to that each solution 
of (10) exists in [to, +oo). Moreover, if the weight functions aij,i,j = 1, . . . , N, are only state- 



dependent, the continuity implies that there will be a* > a* > such that 



a* < aij(x(t)) < a*, Vt > 0, i,j = 1,2, ...N 



(19) 



along trajectory x(t) of system (10). In this case, A4 follows automatically, and then needs not 
to be assumed. 



With Lemma 4.1 for any initial condition, there exists a constant d* > such that lim^oo d(t) 



d* . Clearly, the optimal solution set convergence will be achieved for system (10) if and 



only if d* = 0. Furthermore, since it always holds that di(t) < d(t), there exist constants 
0<9i<r]i<d*,i = l,...,N such that 

liminf di(t) = 9i, limsupdj(i) = rji. 



t—>oo 



t— >oo 



To establish the optimal set convergence, we also need the following lemmas, whose proofs 
can be found in the Appendix. 

Lemma 4.2 Assume that 9i = rji = d*,i = 1, . . . ,N. Then we have limi_> +00 |xj(t)|x 4 = for 
alli = l,...,N. 

Lemma 4.3 Assume that either G a (t) being UJSC or G a (t) being IJC with bidirectional commu- 
nications. Then 0i = rji = d* for all i = 1,2, . . . , N . 
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Remark 4.2 If the network communication graph is undirected, i.e., i G Nj(o~(t)) if and only if 



j G Ni(a(t)) with aij(x,t) = aji(x,t),i, j = 1, . . . , N, then according to (13) and (l7\ ), we have 
N N N 



d_ 

dt 



^2di(t)<2^2 ^2 aij(x,t)(xi - Px (xi),Xj - Xi) -2^2\xi\ 2 Xi 

i=l i=l j&Ni(a(t)) i=l 

N 

= y~] aij(x,t){xi - Px {xi),Xj - Xi) 

i=l jeNi{a(t)) 

N N 
+ Y1 ^2 a ji{ x ^){ x j ~ P X ( x j), x i - Xj) - 2^2 \ X i\x t 

N N 

= y~] ^ a ij (x,t){xi - Xj + Px (xj) - Px (xj),Xj - Xj) -2'y]\x i \ x .. 
i=l jeNiWt)) »=i 

Furthermore, based on and pp, we obtain 

(Xi - Xj + Pxo(Xj) - Px {Xi),Xj - Xi) < -\Xi - Xj\ 2 + \xi - Xj\ ■ \P Xo (Xj) - Px (xi)\ < 

for all i,j = 1, . . . , N. Therefore, we have 



N 



N 



dt 



-2 



i=i 



i=i 



which implies 



I \ x Mh < T d ^o) 
i=i J ° 2 



(20) 



immediately based on Lemma 4-1 



As a result, with (20), we can apply Barbalat's lemma on \xi{t)\ x _, and then it follows 



immediately that limi_>+oo |a;i(t)|xj = 0, i = 1, . . . , N without the assumptions of Lemma 4-2 



Remark 4.3 Note that, Lemmas \4-l\ and \4-2\ hold without requiring any connectivity of the 
system communication graph. 



4.2 Directed Graphs 

The following conclusion is for optimal set convergence with directed communications. 



Proposition 4.1 System (10) achieves the global optimal solution set convergence if G a (t) ^ s 
UJSC. 
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Proof. According to Lemmas 4.2 and 4.3, we have lim^oo = 0, i = 1, . . . , JV. As a 



result, for any e > 0, there exists T\(e) > such that when t > T\, 

\xi(t)\ Xi <e, i = l,...,N. (21) 
Take t\ = T\ and k§ 6 V. Defining hk (t) = maxj g y \xi(t)\x k() , similarly to the analysis of 



(14), we have that for all t, 

4,h 2 k (t) < 2h ko (t) ■ max \xi(t)\ Xi , 

ill 1=1,. ..,iv 

which implies D + h ko (t) < e,t > ti- Thus, h ko (t) < % (ti) + (N-l)T e,t £ [t^h + (JV- l)r ]. 
Since G a (t) ls UJSC, we can find a node k\ such that (ko,ki) G £ a (t) f° r t 6 [ti,ii + r Z)) ^ 



[ti , £i + To), where To = T + 2t£>. In light of Lemma |2.2| and (21 ), we have 

J t \ x kAt)\ 2 x k0 = 2a klko (x,t){x kl - P Xko (x kl ),x ko - x kl ) + 2{x kl - P Xko (x kl ), 

Yl afc u' ( x i ~ x ki)+ p x kl Ofcj )~x kl ) 

jeN kl (a(t))\k 

< -2a,\x kl (t)\ Xko (\x kl (t)\x ko -e) + 2(N-2)a*\x kl (t)\x k0 • (M*i) 

+ (N-l)T e-\x kl (t)\x ko ) + 2\x kl (t)\x ko -e, t€[i lt k+r D ), (22) 

from which we obtain that for any t £ [ti, ti + tjj), 

D + \x kl (t)\x k0 < -(a* + (JV - 2)a*)\x kl (t)\ Xko + (JV - 2)o*[/i fco (*i) + (JV — l)T e] + (1 + a*)e. 

Therefore, noticing that \x kl (t 1 )\ Xko < h ko (ti) + (JV- l)T e and denoting = e-K+C^- 2 )"*)^, 
one has 

I ,r , m < ,\ ( r\\ i/i ^ (JV - 2)a*[h fco (ti) + (JV - l)T Qg ] + (1 + q») £ 
|a*i(tl + r D )| XfcQ < is \x kl {ti)\ Xko + (1 - i/ ) Q<t + (TV - 2)a* 

<u» /i fco (ti) + M e, (23) 



where 



(N-2)a* + a^ 1 + [2(JV - 2)(N - 1)T + l]a* 

(JV - 2)a* + a* a* + (JV - 2)a* 



Proceeding the estimation in time interval [ti + td, t\ + (JV — l)To] will lead to 

D + \x kl (t)\x k0 < -(JV-l)a*|x fcl (t)U fco +(JV-l)a*[/i fco (ti)+(JV-l)T e]+e, i G [ti+r D) ti+(JV-l)T ], 

for all i e [ti + r D , ti + (JV - 1)T ]. This implies 

K(t)|x fcQ < %{w h ko {h) + M e) + (1 - <a,)(t«o/»fco(ti) + ( N ~ !) T o£ + ^37^) 

< w h ko (h) + JVf e, t G [ti + r D ,t! + (JV - 1)T ] (25) 
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where 

_ -e-«-ir**; M„ = ^&_l>!|±il_. ( 26 ) 

a* + (JV - 2)a* 

Further, continuing the analysis on time interval [t\ + Tb,ii + 2Tq], k 2 can be found with a 
neighbor in {ko,k±} during ^2^2+ tu) !_ [ii +?b>*i + 2To]. An upper bound for |a^ 2 (*)|x fe can 
be similarly obtained as 

\x k2 (t)\ XkQ < wihkofa) + 2M e, t e [i 2 + TD ,h + {N- 1)T ] (27) 

Where ^1 = (iV-2)a»+a. ' 

Next, respectively, we repeat the analysis on time intervals [t\ + 2Tq, t\ + 3_o], . . . , \t\ + (JV — 
2)To, t\ + (JV — 1)Tq] for ks, . . . , fcjv-i _ V, and we finally reach 

\xi(tt + {N - l)T )\ XkQ < WN^h^itx) + (N - l)M e, i = l,...,N, (28) 

which implies 

hkafo) < WN-thkoih) + (JV - l)M e, (29) 

where t 2 = h + (N - 1)T and < u^i = < 1. 

Denoting w* = wn~i and t n+ \ = t n + (JV — 1)Tq for n = 2, . . . , and by the same analysis on 
time intervals [t n , £ n +l]j n = 2, . . . , one has 

n-l 



hk (t n ) < w^hkoih) + Y J w t 1 (N - 1)M„£ 



< 



™r + -, _ - g (30) 



Since e in (30) can be arbitrarily small, we see that linn._-.oo \xi{t)\x kQ = for all i, ko 



1, . . . , JV, which immediately implies lim^oo |xj(i)|x = 0- The proof is completed. □ 
4.3 Bidirectional Graphs 

The following conclusion is for optimal set convergence under bidirectional graphs. 



Proposition 4.2 System (10) achieves the optimal solution set convergence with bidirectional 



communications if G a (t) ^ s UC. 



Proof. Suppose d* > 0. According to Lemmas 4.2 and 4.3, we have that for all i = 1, . . . , JV 



lim |xi(t)|x = lim \xi{t)\ Xl = 0. (31) 

t— >oo t— >oo 
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This implies, for any e > 0, we have that Xi(t) G Bo(e) D Bi(e) for sufficiently large t, where 



Bo(e) = {y\Vd* +e < \y\ Xo < Vd* + e} and Bi{e) = {y\\y\ Xi < e}, i = 1, . . . , N. Then we see 

lx 



from (13) that the derivative of is globally Lipschitz. Therefore, based on Barbalat's 



lemma, we know 



d 

t->00 dt 



lim ^-J Xi (t)\ Xo = 0. 



(32) 



Define £oo = {(i, j) G £ a {t) f° r infinitely long time}. Then Q x = (V, £oo) is connected 
since Q([t, +oo)) is connected for all t > 0. 



Let Nf° be the neighbor set of node i in graph G^. With Lemma 2.2 (31) and (32) yield 



that for any i = 1, . . . , N and j G N 



oo 
i ' 



lim (xi(t) - P Xo {xi(t)), Xj (t) - Xi (t)) = 0. 

t— >oa 



(33) 



Taking io G V, we define two hyperplanes: 



Ki(t) = {v\(x io (t) - P Xo (x io (t)),v- x io (t)) = 0}; 



H 2 (t) = {v\{x i0 (t) - P Xo (x io (t)),v- P Xo (x io (t))) = 0}. 



Then Vj G (33) implies that 



which leads to 



lim \ Xj {t)\ Hl{t) = 0; lim \ Xj (t)\ n2{t) 



lim |Px o (^-(0) " *W a (t)te(t))l = 0. 

c— >-oo 



(34) 



Because Goo is connected, we can repeat the analysis over the network, then arrive that (34) 
holds for all j = 1, . . . , N. 

Let C lQ {t) = co{P Xio (x io (t)),P Xo (xi(t)), . . .,P Xo (x N (t))}. Then C io (t) C X J0 ,Vt > 0. 



Therefore, with (31) and (34) and according to the structure of %\{t) and H^it), there will 



be a point G Di^=i (*) — -^o fo r sufficiently large i such that 

(x io (t) - P Xo (x io (t)),z* - P Xo (x io (t))) > 0, 

which contradicts Q. Therefore, d* > does not hold, and then the optimal set convergence 
follows. □ 
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5 Global Consensus 



In this section, we present the consensus analysis. In order to show the consensus, we have to 
present a clear estimation of the influence on state agreement by terms Xi — Pxi = 1, ■ ■ ■ ,N. 



We first introduce a class of positively invariant set for system ( 10 ) which characterizes the 
agreement property in Subsection 5.1. Then the consensus analysis is investigated for directed 
and bidirectional communication cases, respectively in Subsection 5.2. 

5.1 Invariant Set 

We define a multi-projection function: Pi k i k _ 1 ...i 1 '■ K" 1, — > UiLi -^Q with ii, . . . , £ {1, . . . , N}, k = 
1,2,..., by 

Pi k i k -i...h(x) = Px ik Px ik _ x ■ ■ ■ Px n (x). 
Particularly, P$ is denoted by P%(x) = x as the case for k = 0. Let 

r = {/U In, • • • , ik e {1, • • • , N}, k = 0, 1, 2, . . . } 

be the set which contains all the multi-projection functions we define. 

Furthermore, let K be a convex set in R m , and define Ak as Ak = co{P{y)\y £ K,P 6 T}. 
Denoting = max Ar I^WIaa-' based on a similar analysis as the proof of Lemma 4.1, it is 
not hard to find that 

D + g{t) < 0, t > 0. 

This implies, <7(t) = for all t > to once we have g(to) = 0, which leads to the following 
conclusion immediately (see Fig. [2]). 

Lemma 5.1 Let K be a convex set in R m . Then A K = A K x • • • x Ak is positively invariant 



for system (10). 

We next establish an important property of the constructed invariant set A^. 
Lemma 5.2 \y\x < 2max 2£ ^ Mx > Vy G A/f. 



Proof. With Lemma 2.1, any y S A^ has the following form 

m+l 



y=Y J ^P (i) (zi), 



i=l 
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Figure 2: Constructing an invariant set from K = co{yi,y2}- 

where Ya=i X i = 1 with A * ^ °> P ® 6 T and z% € K, % = l,...,m + 1. Then, by the 
non-expansiveness property Q, we have that for any z £ R" 1 and F t £T, 

|PXo(«) " = iPOPxoW) " < I^Xo (z) -z\ = \z\ Xo . 



This leads to 

m+l 



m+1 



m+l 



<*>! 



E A ^I ^ E A *N- P(i> ^)l 



j=l 



i=l 



i=l 
m+l 



m+l 



< - Px {z,i)\ + MPxM - P {i) (zi)\ 



< 2 max \z\x , 

m+l 



which implies the conclusion because Ya=i ^i z i £ K. 



□ 



Now we are ready to reach the global consensus for system (10). Let us focus on each 



coordinate, and denote xf(t) as the £-th coordinate of Xi(t). Moreover, let 



4>(t) = min{xf(t)}, (p(t) = max{xf(i)} 
be the minimum and the maximum within all the agents. Denote H(t) = <p(t) — <p{t). Then a 



consensus is achieved for system (10) if and only if lim^oo H(t) = 0. 



In the next subsection, we will prove the global consensus for system ( 10 ) with directed and 



bidirectional communications, respectively by showing that limi_ 5 . 00 H(t) = 0. 



5.2 Consensus Analysis 

In this subsection, we propose the consensus analysis. First we study the directed case. 
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Proposition 5.1 System (10) achieves a global consensus ifG a (t) ^ s UJSC. 

Proof. Based on Proposition 4.1, we have that lim^oo |a;j(f)|x = for all i = 1,...,N. 



Therefore, for any e > 0, there exists T\(e) > such that, when t > T\, 

\xi(t)\ Xo < -e, i = l,...,N 



(35) 



As a result, according to Lemma 5.2 for any y G A co { Xl (t),...,x N (t)} with t > T\{e), we have 

dist(y, co{xi(t), . . . , x N (t)}) < e. 

Moreover, by Lemma 5.1, we see that Xi(t) G Aco{xi(t) i4 4 4 , XN (t)\, i = 1, ■ ■ • , N for all t < t < oo, 
which implies that for all i > t > Ti, we have 

dist(xi(t), Acoix^^xNit)}) <£, i = l,-..,N. (36) 

We divide the following proof into three steps. 
Step 1: Take t\ = T\ with x\ (t\) = <ft(ti) and denote Tq = T + 2t£>. In this step, we give bound 
to x e iQ (t) during t G \t\, t\ + (N — 1)T ]. 



Based on (36), we see that for all Ti < t < t < oo 

<P(t) > <j){t) - e; v (t) < + e. 

Noting the fact that 

< ~(N - l)a*x\ (t) + {N- l)a>(ti) + e) + e, t > ti, 



(37) 



(38) 



we obtain 



xUt) < mi = ^(h) + (i - %Mh) + 



(JV - l)a* + 1 



e, t €[*!,*! + (JV-l)To]. (39) 



S'fep 2: Since £7<j(t) is UJSC, we can find i\ G V and ii > ti such that (io^l) £ ^o-(t) for i G 
[ii^l+ro) C [ti,ti+To). In this step, we give bound to x\ (ti) during t G [ii+TD,ii+(iV — l)?n]. 
Similarly to the analysis of (22), when i G + td), one has 

^4(*) ^ " 4(*)) + - 2)a*( V (*i) + e - 4(t)) + £, 



which yields 



4(*i + < "o(¥>(*i) + e) + (1 - *b) x 



a^i + {N- 2)a*(tp(ti) + e) + e 



a* + (N - 2)a* 
(1 - w )%<p(ti) + [1 - (1 - w )%]ip(ti) + L e 



(40) 
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after some simple manipulations by combining ( 39 ) and ( 40 ) , where Lq = 1 + 



N 

[o»+(JV-2)o*](JV-l) ■ 



Then, applying (38) on node i\ during t € [ti + Td,£i + (N — 1)Tq] will lead to 



< ftfi + (i - «Mti) + (i ^v r0 1 • £ 

= mi0(*i) + [1 - mi]y?(ti) + L e, 

for all i € [ti + td, ii + NTq], where mi = (1 - u>o)?q and L = %Lq + 1 + nyjxTa* • 
S^ep 3: We proceed the analysis for 12, ■ ■ ■ , ijy-i with = ((1 — u;o)?o) fc ,&: = 2, 
Denoting £2 — *i + (Af — 1)Tq, we obtain 



(41) 



AT - 1. 



4 B (*2) <m 7V -i^(ti) + (l-m JV _ 1 )^(t 1 ) + (iV-l)Loe, g = 0, . . . , N - 1, (42) 
which implies 



<p(t 2 ) < mjv-i^(ti) + (1 - miv-iMii) + (JV - 1)L £- 



(43) 



(37) and (43) lead to 



#(t 2 ) < m N ^(h) + (1 - m 7V -i)^(ii) + (N - l)L e - (<f>(h) - e) 
= (1 - rriN-JHih) + [(AT - 1)L + l]e 



(44) 



Define a time sequence T\ = t\ < ti < . . . with tk = ifc-i + (N — l)To. Applying the same 
analysis on each interval \tk—iitk) wm l ea d to 



H(t k ) < (1 - m w _!)ff(i M ) + [(AT - 1)L + l]e, fc = 1, 2, . . . . 



(45) 



As a result, we obtain 



fc-i 



#(*fc+i) < (1 - m N -i) k H(h) + ^(1 - mAr_i) J [(A r - 1)L + l]e 

j=0 



< (1 - mjv-if il(ti) + 



kuu , , (JV-1)L + 1 



mAr_i 



e, fe = l,2,... 



(46) 



Therefore, noting the fact that < m^-i < 1, (37) and (46) yield 



limsupif(£)<(2+ (iV ~ 1)Lo + 1 )- £ . 

Then lim^oo i^f (£) = since e can be arbitrarily small. This completes the proof. □ 
Then the global consensus for bidirectional case is proved by the following conclusion. 



Proposition 5.2 System (10) achieves a global consensus with bidirectional communications if 
Quit) is IJC. 
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Proof. Take t\ = T\ with x iQ (t\) = (f>{t\) as the proof of Proposition 5.1 Then (36) and (37) 
still hold. 

Denote the first time when iq has at least one neighbor during t >t\ as ti, and denote the 
neighbor set of io for t G [t\,ti + Td) as Vi- Next, we show the bound for io an d j G Vi during 

t g + td) . 

Note that when io has no neighbor during t G for ti < s < oo, one has that for any 

t G [ti,s), 



Then, we see that 



\xUt)-xUs)\<e. 



x\At) < fa 4 <f o 0(i!) + (1 - ?oM*i) + 



(47) 



(iV - l)o* + 1 
(N -l)a* 



for all t G [ti, ii + td], where <fo = e" 



-(JV-l)a*r D 



By similar analysis with ( 40 ) , we have that for any j G Vi , 



x){t x + t d ) < §! = rh^ih) + (1 - m x )<p(ti) + L e 



(48) 



with rhi = (1 — wq)^q. 

When there is no link between V \ ({io} U Vi) and {io} U Vi for t £ \t\ + rjj,t), applying 



Lemma 5.1 on the subsystem formed by nodes in {io} U Vi, (36) leads to 

x e At) < e x + e, t G [ti + T D ,i), j G {i } U Vi. 



(49) 



Therefore, defining t 2 as the first moment during t G [t\ + T£>,oo) when there is an edge 
between j G {io} U Vi and V \ ({io} U Vi), we have 



(50) 



(N - l)a* 
for t G [t 2 ,t2 + td]- 

Denoting V 2 = {k G V| there is a link between k and {io} U Vi at t 2 }, bounds for x e k (t 2 + 
td), k G V2 can be similarly given by 



x{{t 2 + td) < m 2 <t>(ti) + (1 - m 2 M*i) + L o^, 



(51) 



where m 2 = ((1 — woKo) 2 - 

Next, V3, . . . , Vj can be defined until V = {io} U Vi U • • • U Vj since Q a (t) 1S JC. Moreover, 
with rhj = ((1 — wq)^)^ , we have 



4,(*jb + td) < rhjJih) + (1 - TO i0 M*i) + L (iV - l)e, g = 1,. . . ,N. 



(52) 
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Therefore, denoting ti = tj + td, we obtain 

<p(h) < rhjjih) + (1 - rhjoMh) + L (N - l)e, (53) 

which implies 

H(t 2 ) < (1 - rh k )H{t{) + (N — l)L e. (54) 



Then lim^oo ^(0 = holds by similar analysis as the proof of Proposition 5.1 This 



completes the proof. □ 



With Propositions |4.1 4.2, 5.1 and 5.2, it is straightforward to see that the main results of 



the paper, Theorems 3.1 and 3.2 hold. 



6 Conclusions 

This paper addressed an optimal consensus problem for multi-agent systems. With jointly 
connected graphs, the considered multi- agent system achieved not only consensus, but also op- 
timum by agreeing within the global solution set of a sum of objective functions. Assuming that 
each agent can observe the projection information onto the solution set of its own optimization 
component and the intersection of all solution sets is nonempty, the original unconstrained opti- 
mization problem was converted to an intersection computation problem. Control laws applied 
to the agents were simple and distributed. The results showed that a global optimization prob- 
lem can be solved over a multi-agent network under time-varying communications and limited 
interactions. Future work includes randomization in the nodes' decision-making and event-based 
methods in the optimization algorithm design. 

Appendix 

A.l Proof of Lemma 14.21 

Based on the definitions of $i and r/j, when 9i = r\i = d* holds for all i = 1, . . . , N, one has 

lim dAt) = d*, i = 1, . . . ,N 

t— >+oo 

Thus, for any e > 0, there exists T\(s) > such that, when t > 7i(e), 

di(t) G [d* -e,d* +e], i = l,...,N. (55) 
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When d* = 0, then it is easy to see that the conclusion holds because |xi(i)| x 4 < |^j(i)|x 
for all t > 0. Therefore, we just assume d* > in the following. 



According to (13) and (17), it is not hard to find that 
d 



dt 



di(t) < -2\xi\\. + 2(xi - P Xo (xi), ^2 a,ij(x,t)(xj - Xi)). 



(56) 



Furthermore, based on (55) and Lemmas 2.2 and 4.1, one has that when t > T\{e) 



(xi - P Xo (xi),Xj - Xi) < \xi\x ■ I \xi\x - \xj\x \ < 2y / d(t )e 

for alii = 1, . . . , N and j € Ni(<x(t)). 

If the conclusion does not hold, there exist a node iq and a constant Mq > such that 

\x io (t k )\x in = Mo 



(57) 



(58) 



for a time serial < t\ <•••<£&< ifc+i < • • • with lim^oo tk+i = oo. Noting the fact that 

\X 



there is a constant L > such that \a — 6| < L for all a,b G {y| < d(io)} since Ap is 



compact, we have that for all for all i = 1, . . . , N, 



dt 



\Mt)\h 



2 Oi J -(a;i-Px- i (a;i) ! a; 3 --Xi)-2|aci(t)|^ j 

< 2\ Xi (t)\ Xo + 2(A - l)a*|x<(i)Uo • " Xi{t)\ 

< 2d(t ) + 2{N - l)a*^d(t Q )L. 



(59) 



Denoting tq 



Mq 



2y / d(t )+(Af-l)a* v / d(^~L 



and according to (58) and (59), we obtain 



which leads to 



K(*fc)lx i0 > 2 M o> * G [*fe,*fe + To], 



(60) 



(61) 



for all tfc > Ti and e < 



8y/d(t ) 



As a result, we have 



d i0 {t k + T ) < d(t ) - 



+ e 



Therefore, (62) contradicts (55) when e < M ° T ° ; which completes the proof. 



(62) 
□ 



A. 2 Proof of Lemma 14.31 
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We prove the conclusion by contradiction. Suppose there exists a node Iq G V such that 
< 0i < r/i < d* . Then for any e > 0, there exists T\(e) > such that, when t > T\(e), 

di(t) G [0,(f +e], i = l,...,N. (63) 

Take Co = \J\iPio + Via)- Then there exists a time serial 

o < £i <•••<£&<.. . 

with lim^oo tk = oo such that |xi (ifc)|x = Co for all A; = 1, 2, ... . 



According to ( 63 ) and Lemma |2.2| we have that for all t > tk 



< 2(JV - l)a*|x io (i)|x (>/d*+e - K(i)U ), 

which will lead to 



£> + K(t)| Xo < ~(N - l)a*\x io (t)\x + (N- l)a*V^T~e. (64) 
As a result, for t G [s, oo) with s >tk , we have 



K(*)|x < e~ (iV - 1)a ( *- s) |^o(s)|xo + (1 - e^ a (65) 

We divide the following proof into two cases: directed communications and bidirectional com- 
munications. 

Directed Case: Denote Tq = T + 2td. Since Q a (t) 1S UJSC, it is not hard to find that there exist 
%l G V and t\ such that (io,h) G Q a (t) fo r * £ [t i , 1 1 + td) Q [tk ,tk Q +Tq). Then based on (65), 
we obtain 



'0 



(t)\xo < 6 = ?oCo + (1 - So)Vd* + e, t G [4 ,4o + (iV - 1)T ], ( 66 ) 



where ?o = e ^ 1 ) 2a * T °. Thus, for t G [h,ti + Td), one has 

— di^(t) 2[ ^ ^ Q-iij{ x ii -f^o O^ii ) ; x j x ii) 4~ ®iiio { x ii P. Xq ) 5 «E*o ^ii)] 
j£N n (a(t))\i 

< 2(N - 2)a*\x il (t)\ Xo (Vd*T~e - \x h (t)\ Xo ) - o.|z il (t)| Xo (|:r <1 (t)|x " 6), (67) 
which leads to 



D + \x n (t)\ Xo < ~((N - 2)a* + a*)\x h (t)\ Xo + (N - 2)a*Vd*+e + a^i- (6f 
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Therefore, we obtain 



for t G [t±, t\ + td), which implies 



+ Td)|x < Ci - woVd* + e + (1 - w )£i, 



(69) 



where i^o is defined in (24). Furthermore, applying the same analysis of (65) on node i\, one 



has that when t G [ti + td, oo), 

kn^Uo < e -( JV - 1 )«*(t-(*~i+^)) Cl + (i _ e -(JV-lK(M*x-* 2 ,)))VtfT + 7 j (70) 



Combing (66), (69) and (70), we obtain 

|zii(*)|x < m iCo + (1 - mi)Vd* + e, 



(71) 



for all t G [fi + T£),tk + (iV — l)To], where mi = (1 — itfoXo- (^1) a ^ so holds for io since 

< So < «1 < I- 

We can proceed to find a node ii G V such that there is an arc leaving from {iq, i±} entering 
%2 in G([t ko + To,tk + 2Tb)) because is uniformly jointly strongly connected. Meanwhile, 



similar analysis will result in estimations for agent ii with the form (71 ) by m,2 = ((1 — Wq)^) 2 . 

Repeating similar analysis on time intervals [tk + 2Tb, tk + 3Tb], . . . , [t ko + (N — 2)Tb, t ko + 
(N — 1)Tq] respectively, and finally, by m^-i = ((1 — woj^j^ -1 , we obtain 



which yields 



\ Xi (i ko + NT )\ Xo < mjv-iCo + (1 - m N -i)VfP +e, i = l,...,N, 



d(i ko + NT Q ) < m N -i( + (1 - m N -i)y/d* + e. 



(72) 



(73) 



Note that, (73) contradicts the definition of d* since m^-iCo + (1 — mAr_i)v / rf r T~e < V 7 ^* 
for sufficiently small e. The conclusion holds. 



Bidirectional Case: When iq has no neighbor for t G [i/c ,s], by (17) we see that 



No(*)|x < kio(4 )|x = Co, t G [i ko ,s]. 



(74) 



Denote the first moment when zq has at least one neighbor during t G [t ko ,oo) as t±, and 



denote the neighbor set of io for t G + td) as Vi. Then, by a similar analysis as (66), one 
has 

kio(*)Uo < li = ^oCo + (1 - %)Vd*+e, t G [ti,?! + t d ] (75) 
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with <fo = e ( N i)i*ti5_ Thus, according to the same process by which we obtain (69), one also 
obtains 



h(ti +td)\x < w Vd* +e + (1 - w Q )ii = miCo + (1 - rhi)Vd* + e, (76) 



where mi = ?o(l — wo). 

Similarly, we can define I2 as the first moment when there is another node connected to 
{io} U Vi during t > t\ + td. Let V2 be the node set which connect to {io} U Vi at ti- Since we 
have the dwell time for cr(t), without loss of generality, we can always assume that all the links 
between {io}UVi and V2 last for at least td time starting from ti. Moreover, similar estimations 
will lead to 



\xi 2 (t 2 + T D )\ Xo < rh 2 Co + (1 - ifi2)Vd* + e 

for all 12 € {io} U Vi U V2, where 1112 = (?o(l _ ^o)) 2 - 

Furthermore, since Q a (t) ls JC, we can always proceed the upper process until V = {io} U 
Vi U • • • U Vj , and then we obtain 



.1 j 



(tj +t d )\x < m jo ( + (1 - rh jo )Vd* + e, 



with rhj = (?o(l — wq)) 30 > which contradicts the definition of d*. Then the conclusion holds for 
bidirectional case. 

The proof is completed. □ 
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